1832, American English colloquial, from horse (n.), perhaps in referfence to the animal's qualities, or to the abilities of hostlers and coachmen with the animals, perhaps from the same association of "strong, large, coarse" found in horseradish.
horripilation
horror
hors d'oeuvre
hors de combat
horse
horse sense
horseback
horse-car
horse-chestnut
horse-collar
horse-faced